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Abstract 

We consider a Markov-modulated Brownian motion reflected to stay in a strip [0,5]. The 
stationary distribution of this process is known to have a simple form under some assumptions. We 
provide a short probabilistic argument leading to this result and explaining its simplicity. Moreover, 
this argument allows for generalizations including the distribution of the reflected process at an 
independent exponentially distributed epoch. Our second contribution concerns transient behavior 
of the reflected system. We identify the joint law of the processes t, X{t), J{t) at inverse local times. 
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1 Introduction 

In this paper we investigate a Markov-modulated Brownian motion (MMBM) reflected to stay in 
a strip [0,5], where i? > 0. Roughly speaking, an MMBM is a process with piecewise Brownian 
paths with drift and variance parameters determined by a finite-state Markov chain. The variance 
parameters are allowed to be 0, in which case the corresponding pieces are linear. Mathematically, 
MMBM is just a Markov additive process with continuous paths [H Ch. XI]. Letting X{t) be an 
MMBM we construct a doubly reflected process W{t) as 

W{t)=X{t)+L{t)-U{t), (1) 

where L{t) and U{t) are the local times at respectively the lower and the upper barriers (that is at 



and at B), given as the solutions of a Skorokhod problem, see Section 2.1 for details. 

The model considered in this paper is also called in the literature a second-order fluid model or a 
fluid model with Brownian noise. It was introduced as a generalization of an extensively studied fluid 
flow model, where it is assumed that all the variance parameters are 0, making the process piecewise 
linear. Fluid models were initially proposed for manufacturing and telecommunication systems, where 
units of work (products or packets) are processed so fast that they can be modelled as fluid instead of 
discrete units. Since then the use of fluid models has become widespread making it a classical model 
in applied probability with a variety of application areas like the theory of queues and dams, risk 
processes and insurance, environmental problems, etc. The literature on this topic is extensive, we 
only mention the seminal papers [2], a survey [12], and a more recent paper [1] with an extended 
list of references. 
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The second-order fluid models were simultaneously introduced in [3l El [16]. The highly cited 
paper [16] by L. C. G. Rogers can be considered as one of the most influential papers, not just in 
the theory of fluid models, but in the much more general theory of fluctuations of Markov additive 
processes. In [16] the stationary distribution of a reflected MMBM is derived for both a single barrier 
and two barriers assuming that either all the variance parameters are or all are positive, see also 
the comments in Section 3.2 The case of a single barrier, see also [3l [9], is a special case of the latter 
problem with B = oo and is substantially easier to analyze. In fact, in this case the analysis can often 
be extended to more general Markov-modulated Levy models with jumps, where all the jumps are 
either positive or negative; see for example fl5], where the stationary distribution of an infinite buffer 
Markov-modulated M/G/1 queue is obtained. 

The form of the stationary distribution of an MMBM with two reflecting barriers is strikingly 
simple. It is noted in [1,6] , where the result is derived using the theory of generators of Markov 
processes, that there has to be a probabilistic story explaining why the solutions to the differential 
equations reduce so far. We provide a very simple probabilistic argument, which offers this explanation. 
Moreover, this argument allows us to find the stationary distribution of a refiected MMBM with both 
linear and Brownian segments, which to our knowledge has not been done so far (its transform is 
obtained in [7J). Furthermore, we obtain the distribution of the refiected process at an independent 
exponentially distributed epoch, which gives a first insight in the transient behavior of the reflected 
process. 

Our second contribution concerns the transient behavior of the reflected system. We identify the 
joint law of the processes t, X{t), J{t) at inverse local times. We envisage that this key result will find 
various applications; some are mentioned in Section [4| In particular, we show that a result from [7J on 
stationary overfiow and unused capacity is a simple consequence of our result. Moreover, considering 
the special case of a Brownian motion we recover the results from |17j . 

Fluid models play a prominent role in applied probability. The importance comes from the fact 
that they are flexible enough to model a variety of different phenomena, and at the same time the 
analysis often remains tractable. One important observation is that phase-type jumps can be easily 
incorporated in the model. This is done by introducing auxiliary states of J{t) and 'levelling' the 
jumps out, see e.g. |14j . Notice that this observation shows the importance of an MMBM, where 
some variance parameters are allowed to be (the case not analyzed so far in the literature). We also 
remark that the level B of the barrier can be interpreted in different ways. In the queueing context 
it is the buffer size. In the financial setting it can, e.g., represent the height of a dividend barrier, in 
which case U{t) represents the cumulative amount of dividends paid before time t. Throughout this 
paper we use the queueing terminology. 

This paper has two parts: Section [3] containing the results about the stationary distribution, and 
Section |4] discussing the inverse local times. Some basic facts and definitions concerning two-sided 
reflection and MMBM are given in Section [2| 



2 Preliminaries 

Throughout this work we use bold symbols to denote vectors (usually column- vectors) , in particular 
1 and are vectors of Is and Os respectively. We write I for an identity matrix and A„ for a diagonal 
matrix with entries of v on the diagonal. 



2.1 Two-sided reflection 

Let X(t), t > be a real continuous function with X{0) G [0, B] (a flxed sample path of a stochastic 
process). The two-sided reflection W{t) of X{t), with respect to the strip [0,5], is deflned through 
where W{t), L{t),U{t) are real continuous functions which satisfy the following conditions: 
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L{t) and U{t) are non-decreasing with L(0) = C/(0) = 0, 



• W{t) G [0, B] for all t > 0, 

• W{s) = if Vt > s : L(s) < L{t), and W{s) = 5 if Vt > s : [/(s) < U{t). 

The last condition states that the points of increase of L and U are contained in {t > : W{t) = 0} and 
{t > : W{t) = B} respectively. It is known that such a triplet of functions exists and is unique [TT] . 
and is called the solution of the two-sided Skorokhod problem. The functions L{t) and U{t) are called 
local times at the lower and upper barriers respectively, that is at and at B. 

2.2 MMBM and its basic properties 

We start with a rigorous definition of an MMBM, see also [Ji Ch. XI]. Let J{t) be a continuous-time 
irreducible Markov chain with a finite state space E, where \E\ = N, and transition rate matrix Q. 
Denote its invariant distribution through tt. For each i £ E let Xi{t) be a Brownian motion with 
variance af > and drift fii] the vectors with elements and /Uj are denoted through cr and /x 
respectively. We assume that J{t) and all Xi{t) are mutually independent. Letting T be the last jump 
epoch of J before i (T = if there were no jumps), we define X{t) recursively as 

X{t) = X{T) + l{J(,T)=i}{X^{t) - X,{T)) and X(0) = 0. (2) 

ieE 

Informally, X{t) evolves as Xi{t) while J{t) is in state i. The law of J(t)) given J(0) = i 

is denoted through Pj, and the expectation through Ej. Sometimes we consider the process (xq + 
X{t), J{t)) for an arbitrary xq G M and still write {X{t), J{t)) where no confusion can arise. 

Let us now introduce some important concepts related to MMBM. The asymptotic drift of the 
process X{t) is denoted through k := Wmt^ao X {t) / 1 = 'YlieE'^it^i^ which does not depend on the 
initial state of J{t). Next, define the subsets E~^ and E~ of E through 

E^ = E\{i eE -.af = 0, ±^l^ < 0}. 

Thus, e.g., E^ is the set of indices of the processes Xi{t) which are not monotonically decreasing; 
Xi{t),i G E~^ are the processes which hit the set (0,oo) with positive probability. In addition, we let 
A^^ = \E^\ and write M± to denote a restriction of an arbitrary matrix M with rows obtained by 
keeping those and only those rows which are indexed by E^. 

Let Cq be an exponential random variable with rate q > 0, independent of everything else, where 
by convention eo = oo. It is often convenient to consider the process {X(t), J{t)) only until eg, at 
which moment it is sent to some additional absorbing state {dx, dj), in other words - killed. The law 
of such a process is denoted through P''. In order to simplify notation, we also keep writing simply P 
if there is no confusion. We do so in the rest of this section. 

Define the first passage times for x > as 

rt = inf{f > : ±X{t) > x}. 

Note that r^^ = oo if X{t) does not exceed level x before Cq. The continuity of paths and the strong 
Markov property of MMBM, and in addition the memoryless property of the exponential distribution, 
imply that the time changed process J(t+) is a Markov chain itself, see also [16]. Note that J(t+) 
jumps to the absorbing state dj at x = sup{X(t) : < t < e^}. Apart from dj this Markov chain 
can take values only in E~^ . Furthermore it is irreducible when restricted to the set E~^ . Let A"*" 
be the corresponding A^+ x A^+ transition rate matrix of J(t^). Let also 11+ be a A^ x A^"*" matrix 
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with elements Pj(J(rQ ) = j), where i ^ E,j ^ E'^ (with an obvious order); we often simply write 
W{J{tq)). Using this notation we can furthermore write 

P(J(t+)) = n+e'^^^ 

The Markov chain J{t^) (restricted to E^) is recurrent if and only if g = and k > 0. Finally, we 
consider r~ and define the matrices A~ and n~ in an obvious way. Note that the matrices and 
n='= depend on q. In order to stress this dependence and distinguish from the special case of (7 = 0, we 
sometimes call them g-killed versions. 

The matrices A^ and 11^ play a prominent role in the following. It is, therefore, required in 
practice to be able to compute these matrices. There are two methods in the literature. Firstly, one 
can use an iteration scheme, see e.g. [Sj !6]. Secondly, a Jordan normal form of A^ can be obtained 
directly using the theory of generalized Jordan chains, see [TJIH]- Finally, it is known that 

n±(A±)2 ^ A^n±A± + {Q- ql)Yi^ = O, (3) 

where O is x matrix of zeros, see for example [6]. 

3 The stationary distribution 

In the first part of this section we provide an elementary derivation of the stationary distribution of 
{W{t), J{t))] we let {W^J) denote the corresponding random vector. Let J{t) be the time-reversed 
version of J{t\, that is, J{t) is a Markov chain with transition rate matrix l^~^Q^ IS..,^. Define X{t) 
according to ([2|) with J{t) in place of J{t). The law of the time-reversed MMBM is denoted through 
P. We start with the following basic identity 

^{W > x\J = i)= P»(X(t[,_b,,)) > x), (4) 

where t[u,v) = inf{t > : X(t) ^ [u,v)}. This type of representation was first noted in [13] in the 
case of a random walk with two reflecting barriers. A short derivation of its continuous-time analogue 
is given in [4, Prop. 3.7, Ch. XIV], see also [5] for the case of Markov additive input. It is well-known 
that an MMBM can not hit a level without passing it, so we obtain 

F{W >x\J = i)= Pi(r+ < Tj^_J, where x G (0, B]. (5) 

Note that this identity indeed does not hold for x = and i £ E\E^. 

Next, for a, 6 > with at least one being strictly positive consider the matrices 

Cia, b) = P(t+ < r,-, J(r+)) Z)(a, b) = Fir, < t+, J{t,')) 

of dimensions N x and N x respectively. The strong Markov property implies 

Cia, b) = P( J(r+)) - P(r- < r+, J(r+)) = P( J(r+)) - D{a, 6)P_( J(r+^,)), 

where P_ denotes a restriction according to J(0) € E^ . Expand D{a, b) in a similar way to arrive at 

C{a, b) = n+e"^^ - D{a, 6)nl e("+^)^^ , (6) 
D{a,b) = ITe^^' - C(a, 6)n;e('^+^)^" . 

Assuming that k 7^ we denote 

K+ := (I - li-e^^'lite^^^)-^ R- := (I - nle^^+n^e^^")"!, (7) 
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where the inverses are weh defined, because one of the matrices Il_^_e^^ and Il^e^^^ is a transient 
probabihty matrix (and the other is recurrent). Thus 

C{x, B-x) = (n+e^^^ - n-e(^-")^"nle^^'')i^+ (8) 

and then ([s]) leads to the following result 

Theorem 1. If k then for x G (0, i?] it holds that 

F{W > x\jf = (n+e^'^^ - U'e^^-''^^~U+e^^^)K+l. (9) 

Finally, we give a brief comment on the more delicate case of k = 0. The problem of this case lies 
in the fact that the system of equations ([g]) does not identify the matrices C(a, b) and D{a, b) uniquely. 
In fact, exactly one equation is missing. This equation is of the form 

C(a, b){al+ + h+) + D{a, 6)(-61_ + h ) = h, 

where h is any vector which solves Qh + = 0, see |71 Section 7]. 



3.1 Further identities 

First, we present a very simple coupling argument, which allows us to derive an equation that com- 
plements ([9|). Consider the two-sided reflection W{t) of {—X{t), J{t)) in [0,5]. Assuming X(0) = 
and X(0) = S it is easy to see that ¥{W{t) < x\J{t)) = F{W{t) > B - x\J{t)). Letting t oo we 
obtain from 1^ 

Hw < x\jf = F{w >B- x\j)'^ = (n-e(-^-^)^" - n+e^^^n;e^^")K-i, (10) 

where x G [0,5). Note that A+,n+ b ecome A ,n , because the MMBM (— X(t), J(t)) is used to 
construct {W ^ J). 



Note that the equations ([9|) and (10) lead to two different representations of the density ¥{W G 
d^lJ). In addition, one easily obtains the point masses at and B (from (10) and ^ respectively) : 



F{w = o\jy = {u- - n+n:^)e^^ K'i, f{w = B\jy = (n+ - n-ut)e^^ R-^i. 

Finally, IT^ = I and Hi = I and hence W has no mass at (respectively B) given J is in E+ 
(respectively E~). 



3.2 On the result of Rogers [H] 

In this section we comment on the result of Rogers |16] . We are only interested in a fluid model with 
Brownian noise and a finite buffer presented in [161, Section 7]. It is assumed there that the fiuid 
evolves as an independent sum of a Markov modulated linear drift and a standard Brownian motion. 
At first sight, this is a rather special case of an MMBM. Note, however, that the process {X{t), J{t)) 
can be time-changed without changing the distribution of (W^| J) in the following way. We scale time 
by Cj > while J{t) is in state i, that is, we consider a new MMBM specified by the transition rate 
matrix A~^Q and parameters af /ci, ^i/ci. It is easy to see that this new MMBM gives rise to the 
same distribution of (1F| J). Hence, [16], in fact, does not assume more than this: all the variance 
parameters are strictly positive. In other words E'^ = E^ = E and hence 11^ = I. Under this 
assumption ^ results in the following: 

FiW G dx\jf = -(e^^^A+ + e(^-^)^"A-e^^^)(I - e^^'e^^^yH, 
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which is (7.13) of |16j up to the minus sign. Here = fzp, because of the different definition of 
time-reversal (3.3) of [16]. The missing minus sign is a consequence of a mistake in normahzation 
in [TB]. Finally, we note that in [TB] the above result was obtained using the theory of generators 
of Markov processes. It required solving second-order differential equations, and verification of the 
solution (positivity of the density is not established in pTO] though). On the contrary, our result was 
obtained directly using elementary probabilistic arguments. This allowed us to treat the problem in 
its full generality, i.e., no assumption on variances. 

3.3 The distribution at an exponential epoch 

In this section we identify Fi(W{eg), J{eq) = j) for X{0) £ {0,B} (start at a boundary), which 
provides some information of the transient behavior of the reflected process. An inspection of the 
proof of [4, Prop. 3.7, Ch. XIV] reveals that a representation similar to Q holds true for finite time 
T: 

¥i{W{T) > x\J{T) = j) = Fj{^,_B,,) < T,X{ti,^b,x)) > x\J{T) = i), 

where it is assumed that -'^(O) = 0. Note that 7riPj( J(T) = j) = TTjFj{J{T) = i) to arrive at the 
following equation 

Hw{eg) > X, J(e,) = j) = P,(r+ < e„ t+ < r^_^, J(e,) = 0^, 

which in matrix form can be written as 

Hwieg) > x,Jieg)f = A^P^(r+ < r^_,, J(r+))P( J(e,))A;i. 

Moreover, one can show that ([8| holds true under exponential killing. Noting that P(J(eg)) = q{ql — 
Q)~^ we find 

HW{eg) > X, J{eq)f = gA^(n+e^^+ - U-e^^-''^^~Ute^^'')K+{qI - Q)-^A-\ 

where x G (0, B] and all the occurrences of matrices A^ and 11^ refer to the g-killed versions. Finally, 
one can derive a symmetric equation for the case ^(0) = B. The distribution of W{eq) in the case of 
X(0) G (0, B) does not have an explicit form. In this case one needs to resort to its Laplace transform 
as in [7|. 

4 Inverse local times 

This section is devoted to the study of the transient behavior of the reflection system 

{t, X{t), J{t),W{t), L{t),U{t)). More concretely, we characterize the joint law of these processes at 

inverse local times t^,x > and r^, x > 0, where 

= inf{t > : L{t) > x} and = mf{t > : U{t) > x} 

for any x > 0. This key result allows us to answer a number of important questions. For example, 
given X{0) G [0, B] and J(0) G E, when does the buffer become empty for the first time and what is 
the state of J{t) at this time? What is the amount of lost fluid until then? Mathematically speaking, 
we are interested in {tq , J{t^),U{tq)). We can also ask: what is the length of an arbitrary busy 
period? What is the amount of lost fluid during a busy period given there was a loss? Moreover, 
we condition on the state i of J(t) right before this busy period starts and the state j at which it 
finishes. These quantities are described by the jumps of and U{t^) given there is a corresponding 
transition of J{t^). The answer to these questions is immediate in view of Theorem [2] Moreover, in 
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Section 4.4 we show that the stationary overflow and unused capacity vectors can be trivially obtained 
from Theorem [2] by doing so we recover a result from [7J. Finally, in Section 4.5 we consider a special 
case of a simple Brownian motion and recover the results from [T7j, where as an easy consequence an 
asymptotic variance of the overflow process is obtained. 

It should be noted that the analysis of the two-sided reflection problem, compared to the one-sided 
one, is considerably harder. The main problem lies in the fact that there are two local time processes, 
which are interrelated in an intricate way. The crucial idea is to study the set of points x > such 
that X{t^) = y for a fixed y E M, see Lemma [sj This idea in a simpler form also appears in \16\ 
Section 5], where it was used to derive point masses of W{t) at and B in stationarity. 



4.1 Markov additive processes 

It will be shown that {X(t), J{t)) observed at inverse local times is a Markov additive process (MAP). 
In this section we present a definition and some basic properties of a MAP. A MAP is a bivariate 
Markov process (Y{t), J{t)), which satisfies the following property for every T > 0. Given J(T) = i 
the shifted process Iy{T + t)- Y{T), J{T + i)), t > is independent from {Y{t), J{t)),0 < t < T and 
has the same law as {Y(t), J{t)),t > given J(0) = i. It is commonly assumed that the state space 
of J{t) is finite, in our case it is a subset of E. Such a process can be seen as a Markov-modulated 
Levy process with additional jumps at the transition epochs of J{t), see (Jj Ch. XI]. Hence a MAP 
with continuous paths is an MMBM. Importantly, if Y{t) has no negative jumps, then for all a < 
there exists a square matrix function F(a) such that 

E[e"^W; J(t)] = e^(")*, (11) 

where the term on the left side denotes a matrix with elements Ej[e"-^''*-'l|j^^-j^^.|] for i,j in the state 

space of J{t). One can see now that F{a) uniquely specifies the law of the process {Y{t), J{t)). This 
matrix can be written explicitly in terms of the Levy exponents of the underlying Levy processes, the 
Laplace transforms of the additional jumps (at transition epochs), and the transition rate matrix of 
J{t). Finally, there exists a (Perron- Frobenius) eigenvalue k{a) of F{a), which is real and is larger 
than the real parts of all the other eigenvalues of F{a). 



4.2 The main result 

We start by making the following observations: 

• and hence also J{t^), X{t^),U{t^) are right-continuous; 

• L{t^) = X by the continuity of L{t); 

• W{t^) = 0, because is a point of increase of L{t); 

• U{t^) is piece-wise constant; 

• X{t^) = U{t^) — X is piece-wise linear. 

Moreover, by the strong Markov property of {X{t), J{t)) it follows that (X(r^), J{t^)) is a MAP, and 
in particular J{t^) is a Markov chain. Note also that J{t,^) is an irreducible Markov chain taking 
values in E~ . The additive component X{t^) has no negative jumps, hence there exists a x N~ 
matrix function F^{a) for all a < 0, such that 



see Section 



4.1 



Clearly, similar statements hold true with respect to . 
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Consider the reflected system under the time change t = (and similarly t = t^) and note using 
the above observations that it is enough to characterize the trivariate process {t^ , X{t^), J{t^)). 
This process is a MAP with 2-dimensional additive component, and hence is uniquely specified by the 
following quantity 

E^Je"^("-)-«"-^ J(rJ^)] = E^Je"^("^)-'?"o^; J(ro^)]e-^^(°'«)^ (13) 

where KxqIc^^'^^'^o^^i'^o J^^Tq)] describes the initial distribution, and F^{a,q) is the corresponding 
matrix exponent. Note that q >0 can be seen as the rate of an independent exponential killing of the 



original process. The formula (13) generalizes (12) by allowing for arbitrary q>0, X{0) = xq G [0,B] 



and J(0) G E. In the following we do not explicitly write the killing rate q in order to simplify 
notation. 

As it was shown above, the joint law of {t, X{t), J{t), L{t),U{t)) observed at i = t^,x > is 
uniquely characterized by the quantities E^^^ [e""'^*^'^o ^; J(rQ')] and F^{a) {q is implicit here). Hence 
our goal is to determine these quantities, as well as those corresponding to . Define N x and 

X A^+ dimensional matrices M^{a) and M^(a) through 

M^(a) =E,Je"^(^o"); J(ro^)](F^(a))-\ M^(a) = E,Je-^(-o^); J(ro^)](F^(a))-i 

for those values of q > and a < for which the inverses are well-defined. Letting xq = and 
restricting the rows of M^{a) to E- we get (F^(a))-^ Hence E^Je^-^^^t^); J(ro^)] and F^{a) are 
readily obtained from M^{a) (a similar statement is true with respect to r^). We, therefore, aim to 
determine the matrices M^{a) and M^(a). 

Let p^,p^ and k^{a),kF {a) be the Perron- Frobenius eigenvalues of A"'",A~ and F^[a),F^{a) 
respectively. It is well-known that < 0. If g > then the inequalities are strict. If g = and 

K 7^ then one of the inequalities is strict depending on the sign of k. In the following we exclude the 
exceptional case of g = and k = 0. We are ready to present our main result. 

Theorem 2. Let a G (p^,— p+). Then k^{a),k^{a) < and M^{a),M^{a) are uniquely specified 
by 




[M^{a),M^{a)]\^_^^^^^^ ''-^ " ) = [H" (A" - al)-^e^«^ , n+(A+ + aI)-^e(-^-^°)^^]. (14) 

We make some comments concerning this theorem. Firstly, k^{a) < and k^{a) < ensure that 
the matrices M^{a) and M^{a) are well-defined. Secondly, a simple algebraic manipulation shows 



that ( 14 ) can be equivalently rewritten as 

M^{a) = (U-{A- - aI)-ie^o^" + n+(A+ + al)-ie(^-^'«)^^n;e^^") K~ , (15) 
M^(a) = (n+(A+ + aI)-ie(^-^'o)^^ +n-(A- -al)-ie^'<'^"nle^^^)i^+. 



where K and are given in ([t]) and are well-defined unless q = n = 0, which was excluded from 
our consideration. 

Remark 4.1. Theorem [2] can be rewritten in a very concise way using a generalized Jordan pair (y,T) 
of the analytic matrix function l/2A^a^ + A^a + Q — ql, see 0. In particular, using Lemma 6.3 
from [7] we arrive at 

^^Jbf) =[n«I-r)-ie-or], 
This expression may be used in practice when one is interested in computing the matrices M^{a) and 



[M^(a),M^(a)] 



8 



4.3 Proof 



The crucial idea of the proof of Theorem [2] is to consider the points 2; > such that X(t^) = y for a 
fixed y eM.. Hence we define x^^^ = inf{x > : X{t^) = y} and x^") = inf{x > x^""^) : X{t^) = y} 
for n > 1. Recall that X{t^) = U{t^) — X is piecewise linear with slope —1, so x^"^ is strictly larger 
than x^""^-*. Equivalently, we can look at the time points t > 0, such that the local time process L(-) 
is increasing and X(-) is at a fixed level y at the time t. The following lemma provides the connection 
between the above mentioned points and some quantities which are easily computable. 



Lemma 3. Let 
It holds a.s. that 



qy = inf{t > T+^y : X{t) < y}. 



c,y ify>0 

Moreover, for y = and X(0) = 0, J(0) € it holds a.s. that 

r .{1) = ?o- 

Let us provide some explanation of this result, see also Figure [T} If y < then the first passage 

B + y 



Xq 

y 



Figure 1: A sample path of X{t). 



time of the level y must be a point of increase of otherwise W{t) becomes negative. If y > 
then the first passage time of the level y may not be a point of increase of L{t). It is necessary that 
the buffer is empty when X{t) passes level y, which is only possible if an overflow has occurred before. 
Hence X{t) should drop by at least B at the time of hitting y, which implies t^^o) = In order to 
characterize r^(„) , n > 1 we use the strong Markov property. Hence we only need to consider the case 
of y = and X(0) = 0, J(0) G E~ . In this case r^(Q) = and r^(i) = ?o by a similar argument as 
above. We only present a rigorous proof of this latter result. 

Proof of Lemma\^ We assume that y = ^(0) = 0, J(0) G E~ and let r := t^{i) ■ First, we show that 
r < 00 implies % < t. Observe that = W{t) = X{t) + L{t) — U{t) and so U{t) = L{t) > 0, because 
T > Tq = 0. Hence there was reflection from above before r. Let f = sup{t G (0, r) : W{t) = B} 
then W{f) = B,U{t) — U{f) = and L{t) — L{f) > 0, because L is non-decreasing. Thus B = 
W{f) - W{t) = X{f) + L(f) - L(t) and so X{t) > B. But X{t) can not hit B without passing it 
with probability 1, hence < t a.s. 

Using the first part, note that if <jo = 00 then r = 00. Assuming % < 00 one can easily see that % 
is a point of increase of L{t). But X{<:^q) = so by the definition of r we have r < <jo, which concludes 
the proof. □ 
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Observe that 

P(J(r|-|))=n-e(^«-^)^" ify<0, 
F{J{^y)) = n+e(-^+^-^o)^^n;e^^" if y > 0, 

where xq S [0,B]. Moreover, K~ defined in (7) can be written as K~ = Yl'^=o (j^-e^^^^+e^^ ^ • 
These facts and the strong Markov property lead to the fohowing corohary. 

Corollary 4. It holds that 

^T. hxir^-)=y,Jir^^)} = n-e(^'o-^)^-i^-, y < 0, 

a;>0 

The final step of the proof is given in the following lemma. 
Lemma 5. For any measurable non-negative function f it holds a.s. that 

poo POO 

/ /(^(Ti'))i{j(.^^)=,}da;= / f{y)^l{x{r^L^^y,Jir;^)=j}dy- 

JO J-OO 

Intuitively this lemma states that we can interchange the 'integrals'. 

Proof. Recall that X{t^) = U{t^) - x and U{t^) is piecewise constant. Suppose U{t^) = C for all 
X G [5, r) then it is immediate that 



/oo 



xe[s,T) 

f{y)l{(^C-yMS,T),J{rS_^)=j}^y= I /('^-a^)l{J(r,i)=i}dx. 

Summing over all such intervals yields the statement of the lemma. □ 
Proof of Theorem^ Apply Lemma [s] with f{y) = to Corollary [4] to obtain 

poo poo poo 

/ E[e°^(^-^); J(Ti')]dx = n- / e^('^"-"'')dye^o^"K- +n+ / ey^^''+''^^dye^^-''<'^^^U-e^^' K~ . 
Jo Jo Jo 

Consider the MMBM (-X(t), J(t)) started in B - xq to find that 

roc roo /'CO 

/ E[e"^(^-''); J(rf)]dx = n+ / e^(^^+"^)dye(^-"o)^+i^+ + n- / e^(^"-"^)dye"°^"nie^^^i^+. 
Jo Jo Jo 

The integrals on the right hand sides converge if p"*" + a < and p~ — a < 0, that is a G {p~ , —p'^)- 
Hence the left hand sides converge for such a. Use (13) to see that ^^(a) < 0,/c^(a) < and (15) 
holds. □ 
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4.4 Stationary overflow and unused capacity 

Recall that J{Tx) and J{Tx) are irreducible recurrent Markov chains. Denote the corresponding sta- 
tionary distributions through tt^ and tt^ . Define \\mt^oo L{t)/t = and similarly limt^oo U{t)/t = 
kF , which do not depend on the initial distribution of (-'^(O), J(0)). Noting that {r^ <i} = {x < L{t)} 
we write 

1 /"^W 1 



lim 

t—^oo t 



l{JirL)=i}dx = lim - I l|^(,^i)=,^,L<i|dx a.s., (16) 



"'^ Jo 



i.e., one can interpret the vectors k tt and k tt as the mean unused capacity and the mean overflow 
in a unit of time in stationarity. 

These quantities were identified in |7J using martingale calculations and the theory of generalized 
Jordan chains. 



Proposition 6. 



-nie 



BA+ 



-nie 



' K(0,7r+), if K>0 
0, ifK = 

—k{tt~, 0), if K < 



(17) 



where q = and tt^ is the stationary distribution associated with whenever ±k > 0. 



This result is Corollary 5.1 of [7j. Note that (17) uniquely identifies k^tv^ and k^tv^ if k 7^ 0. If, 
however, k = 0, then an additional equation is required, see |7j for details. It should be mentioned, 
that stationary overflow and unused capacity for an arbitrary MAP are considered in [5] . The results 
of this paper, however, depend on the stationary distribution, which has no explicit solution unless 
the MAP can be reduced to an MMBM. Moreover, a restrictive assumption about the number of roots 
of a certain equation is made, which can fail even in the case of an MMBM. 

In the following we retrieve the above result by a simple argument using Theorem [2} Observe that 
-M^(0) = /o°°P(t^ < eq,J{T^))dx and hence by (fl6|) we get -limqioq[M^{0)].. = K^nf for any 
i & E,j £ E~ . A similar identity holds true if one considers r^. Firstly, note that — n+(A+)^^ = 
/o°°P(r+ < eg, J(r+))drE and {t+ < e^} = {x < X{eq)], where X{t) = sup{X(s) : < s < t}. 
Secondly, it is well-known that limt_>oo X{t)/t = Klj^^g}- Finally, consider (14) with q > and a = 0, 
multiply both sides by q and let g J, to see that every row of this equation reduces to (17). 



4.5 Special cases 

An important special case arises when E~ = = E, that is there are no states when the process 
evolves deterministically (a Brownian component is always present). In this special case n~ = 11"'" = I 



and hence (15) reduces to 



M^{a) = ((A- - aI)-ie^'o^ + (A"^ + aiy'e 
Letting xq = and taking the inverse we obtain 



l^{B-xo)A+^BA- 



^BA+^BA- 



e — - e— I I (A- - aiy^e-""^' + (A+ + al)-ie^^+) 



Moreover, observing that X{tq ) = U{tq) we find from (15) that 
E.o=B[e"^(^o^)-^-^;J(ro^)] 

= ((A- - al)-i + (A+ + al)-i) ((A~ - al)-^e~^^~ + {A+ + aiy^e^^'' 



(A- - al) ^ (A+ + A") (e-^^ (A"'" + al) + (A" - al)e 



BA^ 



-1 



(A- 



al) 



(18) 



(19) 
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where in the last step we used the fact that (A^ + al)^^ and e^^^ commute. A number of other 
useful transforms can be found using similar algebraic manipulations. 

Next, we restrict ourselves to the case of a single state, that is, we consider a Brownian motion 
(o"^,/i). Without real loss of generality it is assumed that = I. According to ([s]), A = A^ is a 
solution of 1/2A^ =F fJ-^ — q = 0. Moreover, A^ is negative unless q = and ±fi > 0, in which case it 



is 0. Thus A+ = ;U — 7 and A = —fi — 7, where 7 = \/ fJ-'^ + 2q. Now the right side of (19) reduces to 
-27/[e^(^+'^)(/u + a - 7) - e^^^'''^\^l + + 7)] and so 



^ ^ cosh(S7) - ^ sinh(57) ' ^ ^ 

where a G (— /i — 7, — /i + 7) according to Theorem[2j Fix q > for a moment, so that 7 > 0. Multiply 
both sides of the equation by the denominator in the right hand side and observe that the Laplace 
transform is analytic in I{e{a) < —fi + 7. Thus the latter equality holds in this domain. This shows 



that (20) holds for all g > 0,a < 0. By symmetry we obtain 



Eo[e~''^^^o)-ir^] = g>0,a>0, 

^ ^ cosh(S7) + ^ sinh(B7) ' ^ 

which is equation (7) in ^17j. Taking limits on both sides we show that this equation holds true also 
for g = 0, unless /i = 0, in which case 

^^-aLirU) ^ i/(i + Q,_B) by the L'Hopital's rule. It is noted that 
in [T7] a very different approach is used. It uses stochastic integration and relies on a sophisticated 
guess of the right form of a certain function. Our approach, however, is direct and is based on simple 
probabilistic arguments. 

Let us conclude by making some additional comments about the Brownian motion with two re- 
flecting barriers. Firstly, the strong Markov property of X{t) implies that the nondecreasing piecewise 
constant process U{t^) has memory-less jumps and inter-arrival times, implying that it is a Poisson 



process with exponential jumps. Let us confirm this and find the corresponding rates. Note that (18) 
can be rewritten as 



7 coth(i?7) — + a) 



Hence if 7^ 0, then 



logEe"^(^f ) = F\a) + a = -"McotM^i^) + 1) 

a — fi[coth[fiB) — 1) 



which implies that U{t^) jumps with rate /x(coth(/iB) + 1) = 2/x/(l - e'^M^), and the jumps are 
exponential of rate ^(coth(/x5) - 1) = 2fi/{e'^^'^ - 1). If /i = then logEe^^^^f) = a/{l - aB), that 
is, both rates become 1/B. 
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